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DETAILED ACTION 

1 . This FINAL action is responsive to the RCE filed on 10/26/2007. 

2. This is a first action final since no claim amendments were submitted only reconsideration of arguments filed 
with the RCE. 

3. Claims 1-28 are pending. Claims 1, 6, 11, 13, 18, 23 and 26 are independent claims. 

Claim Rejections - 35 (JSC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set forth 
in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 1 02 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to 
a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

5. Claims 1,4-7, 10-11, 13, 16-19, 22-23 and 25-27 remain rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kondo (U.S. 5,713,021, filed Sep 14, 1995) in view of Kanevsky (U.S. 7,075,671, filed Sep 14, 
2000). 

Regarding Independent claims 1,13 and 23, Kondo discloses A computer-implemented method of 
generating a paper document based upon a plurality of multimedia documents storing multimedia 
information in electronic form, the method comprising: Receiving input identifying a selection criterion 
(abstract, column 1, lines 55-67 & column 2, lines 1-17, wherein the search system includes input identifying 
a selection criterion for searching a portion of multimedia data); Analyzing the multimedia information stored 
by the plurality of multimedia documents in response to the input to identify portions of multimedia 
information that satisfy the selection criterion, the identified portions of multimedia information including at 
least a first portion extracted from a first multimedia document from the plurality of multimedia documents 
and a second portion extracted from a second multimedia document from the plurality of multimedia 
documents (abstract, column 1, lines 55-67 & column 2, lines .1-17, wherein portions of multimedia data are 
searched based on the users search data. Further column 16 lines 20-28 states "If view objects in non- 
sequential periods, such as the one included in another file of video, or the one included in non-sequential 
portions of video, they are grouped as the set S that is a set of non-sequential view objects" here Kondo at 
least suggests that portions of multimedia data can be retrieved for more than one multimedia file, thereby 
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including a second portions extracted from a second multimedia); Kondo fails to explicitly teach the printing 
of the portions of multimedia data. Kanevsky teaches Printing the portions of the multimedia information that 
satisfy the selection criterion , including the extracted first portion and the extracted second portion, on a 
paper medium to generate the paper document comprising a set of one or more printed pages (abstract, 
column 5, lines 55-67, wherein portions of data from multimedia based on the user criteria are printed. Has 
indicated previously Kondo suggests retrieving portions from more than one multimedia document). Both 
Kondo and Kanevsky deal with multimedia information. At the time of the invention it would have been 
obvious to one of ordinary skill to include printing of multimedia data. The motivation for doing so would have 
been to provide an additional device capable of displaying multimedia data in real-time when a computer 
cannot display the data on a display device due to limited availability. 

Regarding Dependent claims 4, 10, 16 and 22, Kondo teaches wherein receiving input identifying the 
selection criterion comprises: Receiving information identifying a topic of interest (abstract, column 1, lines 
55-67 & column 2, lines 1-17, wherein the search system allows the user to search based on a criteria that 
includes identifying a topic of interest). 

Regarding Dependent claims 5, 17 and 25, Kondo fails to explicitly teach the printing of the portions of 
multimedia data. Kanevsky teaches wherein printing the portions of the multimedia information that satisfy 
the selection criterion on the paper medium to generate the paper document comprises: Generating a 
printable representation for the portions of the multimedia information that satisfy the selection criterion 
(abstract, column 5, lines 55-67, wherein portions of data from multimedia based on the user criteria are 
printed. Has indicated previously Kondo suggests retrieving portions from more than one multimedia 
document); Printing the printable representation on the paper medium to generate the paper document 
(abstract, column 5, lines 55-67, wherein portions of data from multimedia based on the user criteria are. 
printed.). 

Regarding Independent claims 6, 18 and 26, Kondo teaches selecting portions of data from multimedia 
information. Further he suggests that portions of multimedia data can be retrieved for more than one 
multimedia file, thereby including a second portion extracted from a second multimedia (abstract, column 1, 
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lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the printing of the 
portions of multimedia data. Kanevsky teaches A method of generating a paper document using multimedia 
information stored by a first multimedia document and a second multimedia document, the method 
comprising: Receiving input identifying a selection criterion; Accessing printable representations for the first 
multimedia document and the second multimedia document; Analyzing the printable representation for the 
first multimedia document in response to the input to identify at least one portion of the printable 
representation that satisfies the selection criterion ; Analyzing the printable representation for the second 
multimedia document in response to the input to identify at least one portion of the printable representation 
that satisfies the selection criterion ; Generating a consolidated printable representation that includes the at 
least one portion of the printable representation for the first multimedia document and the at least one 
portion for the second multimedia document that satisfy the selection criterion ; Printing the consolidated 
printable representation on a paper medium to generate the paper document comprising one or more 
printed pages (abstract, column 5, lines 55-67, wherein portions of data from multimedia based on the user 
criteria are printed. Has indicated previously Kondo suggests retrieving portions from more than one 
multimedia document). Therefore at the time of the invention it would have been obvious to one of ordinary 
skill in the art to analyze the printed representations based on the user criteria. The motivation for doing so 
would have been to associate a portion of data from different multimedia on a single printed document 
based on the user specified search criteria thereby saving paper by organizing multiple data on a printed 
representation based on a topic. 

Regarding Dependent claims 7, 19 and 27, wherein: Kondo teaches selecting portions of data from 
multimedia information. Further he suggests that portions of multimedia data can be retrieved for more than 
one multimedia file, thereby including a second portion extracted from a second multimedia (abstract, 
column 1, lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the 
printing of the portions of multimedia data. Kanevsky teaches Analyzing the printable representation for the 
first multimedia document comprises determining at least one page in the printable representation for the 
first multimedia document that comprises information that satisfies the selection criterion ; Analyzing the 
printable representation for the second multimedia document comprises determining at least one page in the 
1 printable representation for the second multimedia document that comprises information that satisfies the 
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selection criterion; Generating the consolidated printable representation comprises including the at least one 
page from the printable representation for the first multimedia document and the at least one page from the 
printable representation for the second multimedia document in the consolidated printable representation 
(abstract, column 5, lines 55-67, wherein portions of data from multimedia based on the user criteria are 
printed. Has indicated previously Kondo suggests retrieving portions from more than one multimedia 
document). Therefore at the time of the invention it would have been obvious to one of ordinary skill in the 
art to analyze the printed representations based on the user criteria. The motivation for doing so would have 
been to associate a portion of data from different multimedia on a single printed document based on the 
user specified search criteria thereby saving paper by organizing multiple data on a printed representation 
based on a topic. 

Regarding Independent claim 11, Kondo teaches selecting portions of data from multimedia information. 
Further he suggests that portions of multimedia data can be retrieved for more than one multimedia file, 
thereby including a second portion extracted from a second multimedia (abstract, column 1 , lines 55-67 & 
column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the printing of the portions of 
multimedia data. Kanevsky teaches A paper document that comprises: one or more pages, wherein at least 
one page of the one or more pages is imprinted with text information that is extracted from multimedia 
information stored by a plurality of multimedia documents if the text information satisfies a selection criterion, 
the multimedia information analyzed in response input that identifies the selection criterion, and wherein the 
at least one page is imprinted with one or more video frames corresponding to the text information extracted 
from the plurality of multimedia documents (column 5, lines 55-67 & abstract, column 5, lines 55-67 & 
column 3, lines 5-15, wherein data from portions of multimedia is converted to textual data based on user 
criteria. Further the textual data is printed. Also Kanevsky indicates that video data is printed). Both Kondo 
and Kanevsky deal with multimedia information. At the time of the invention it would have been obvious to 
one of ordinary skill to include printing of multimedia data. The motivation for doing so would have been to 
provide an additional device capable of displaying multimedia data in real-time when a computer cannot 
display the data on a display device due to limited availability. 
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6. Claims 2-3, 8-9, 12, 14-15, 20-21 , 24 and 28 remain rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kondo (U.S. 5,713,021, filed Sep 14, 1995) in view of Kanevsky (U.S. 7,075,671, filed Sep 14, 2000) further in 
view of Orr (U.S. 6,430,357, filed Sep 22, 1998). 

Regarding Dependent claims 2 and 14, Kondo teaches selecting portions of data from multimedia 
information. Further he suggests that portions of multimedia data can be retrieved for more than one 
multimedia file, thereby including a second portion extracted from a second multimedia (abstract, column 1, 
lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the printing of the 
portions of multimedia data. Kanevsky teaches wherein printing the portions of the multimedia information 
that satisfy the selection criterion on the paper medium to generate the paper document comprises: Printing 
text information on at least one page of the set of printed pages of the paper document such that words in 
the text information that satisfy the selection criterion are annotated, wherein the text information is extracted 
from the portions of the multimedia information (abstract, column 5, lines 55-67 & column 3, lines 5-15, 
wherein data from portions of multimedia is converted to textual data. Further the textual data is printed). 
Kanevsky does teach the textual data from portion of the multimedia information but does not include 
annotation based on the user defined criteria. Orr teaches the annotation of multimedia data including text 
data from closed caption information (column 2, lines 55-67 & column 4, lines 50-62), whereas Kanevsky 
teaches the user criteria used to extract textual data from multimedia data. At the time of the invention it 
would have been obvious to one of ordinary skill in the art to include annotation of textual data related to a 
portion of multimedia data. The motivation for doing so would have been to allow navigation to specific 
portions of multimedia data based on the annotated data. 

Regarding Dependent claims 3 and 15, Kondo teaches selecting portions of data from multimedia 
information. Further he suggests that portions of multimedia data can be retrieved for more than one 
multimedia file, thereby including a second portion extracted from a second multimedia (abstract, column 1, 
lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the printing of the 
portions of multimedia data. Kanevsky teaches wherein printing the portions of the multimedia information 
that satisfy the selection criterion on the paper medium to generate the paper document comprises: Printing 
one or more video frames on at least one page of the set of printed pages of the paper document such that 
at least one video frame that satisfies the selection criterion is annotated, wherein the one or more video 
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frames are extracted from the portions of the multimedia information (column 5, lines 55-67, wherein the 
user chooses one section of the video to print based on the criteria selected by the user). Kanevsky does 
teach printing of data including video data from a portion of the multimedia information but does not include 
annotation based on the user defined criteria. Orr teaches the annotation of the video information (column 1 , 
lines 55-62). At the time of the invention it would have been obvious to one of ordinary skill in the art to 
include annotation of video data related to a portion of multimedia data. The motivation for doing so would 
have been to allow navigation to specific portions of multimedia data based on the annotated data. 

Regarding Dependent claims 8 and 20, Kondo teaches selecting portions of data from multimedia 
information. Further he suggests that portions of multimedia data can be retrieved for more than one 
multimedia file, thereby including a second portion extracted from a second multimedia (abstract, column 1, 
lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the printing of the 
portions of multimedia data. Kanevsky teaches wherein printing the consolidated printable representation on 
the paper medium to generate the paper document comprises: Printing text information on at least one page 
of the one or more printed pages of the paper document such that words in the text information that satisfy 
the selection criterion are annotated (abstract, column 5, lines 55-67 & column 3, lines 5-15, wherein data 
from portions of multimedia is converted to textual data. Further the textual data is printed). Kanevsky does 
teach the textual data from portion of the multimedia information but does not include annotation based on 
the user defined criteria. Orr teaches the annotation of multimedia data including text data from closed 
caption information (column 2, lines 55-67 & column 4, lines 50-62), whereas Kanevsky teaches the user 
criteria used to extract textual data from multimedia data. At the time of the invention it would have been 
obvious to one of ordinary skill in the art to include annotation of textual data related to a portion of 
multimedia data. The motivation for doing so would have been to allow navigation to specific portions of 
multimedia data based on the annotated data. 

Regarding Dependent claims 9 and 21, Kondo teaches selecting portions of data from multimedia 
information. Further he suggests that portions of multimedia data can be retrieved for more than one 
multimedia file, thereby including a second portion extracted from a second multimedia (abstract, column 1 , 
lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the printing of the 
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portions of multimedia data. Kanevsky teaches wherein printing the consolidated printable representation on 
the paper medium to generate the paper document comprises: Printing one or more video frames on at least 
one page of the one or more printed pages of the paper document such that at least one video frame of the 
one or more video frames that satisfies the selection criterion is annotated (column 5, lines 55-67, wherein 
the user chooses one section of the video to print based on the criteria selected by the user). Kanevsky 
does teach printing of data including video data from a portion of the multimedia information but does not 
include annotation based on the user defined criteria. Orr teaches the annotation of the video information 
(column 1 , lines 55-62). At the time of the invention it would have been obvious to one of ordinary skill in the 
art to include annotation of video data related to a portion of multimedia data. The motivation for doing so 
would have been to allow navigation to specific portions of multimedia data based on the annotated data. 

Regarding Dependent claim 1 2, with dependency of claim 1 1 , Kondo fails to explicitly teach the printing of 
the portions of multimedia data. Kanevsky teaches the printing of multimedia data based on a user defined 
criteria (column 5, lines 55-67 & abstract, column 5, lines 55-67 & column 3, lines 5-15, wherein data from 
portions of multimedia is converted to textual data. Further the textual data is printed). Kanevsky fails to 
explicitly teach extraction of textual data from the closed caption information of the multimedia data. Orr 
teaches wherein the text information is extracted from closed-caption text information or audio information 
included in the multimedia information stored by the plurality of multimedia documents and the one or more 
video frames are extracted from video information included in the multimedia information stored by the 
plurality of documents (column 2, lines 55-67, wherein text data is extracted from closed caption data). At 
the time of the invention it would have been obvious to one of ordinary skill in the art to obtain textual data 
from closed caption data. The motivation for doing so would have been to allow navigation to specific 
portions of multimedia data based on the annotated text. 



Regarding Dependent claim 24, with dependency of claim 23, Kondo teaches selecting portions of data 
from multimedia information. Further he suggests that portions of multimedia data can be retrieved for more 
than one multimedia file, thereby including a second portion extracted from a second multimedia (abstract, 
column 1, lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the 
printing of the portions of multimedia data. Kanevsky teaches wherein the code for printing the portions of 
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the multimedia information that satisfy the selection criterion on the paper medium to generate the paper 
document comprises: Code for printing text information on at least one page of the set of printed pages of 
the paper document such that words in the text information that satisfy the selection criterion are annotated, 
wherein the text information is extracted from the portions of the multimedia information; Code for printing 
one or more video frames on the at least one page such that at least one video frame that satisfies the 
selection criterion is annotated, wherein the one or more video frames are extracted from the portions of the 
multimedia information (column 5, lines 55-67, wherein the user chooses one section of the video to print 
based on the criteria selected by the user). Kanevsky does teach printing of data including video data from a 
portion of the multimedia information but does not include annotation based on the user defined criteria. Orr 
teaches the annotation of the video/text information (column 1, lines 55-62). At the time of the invention it 
would have been obvious to one of ordinary skill in the art to include annotation of video/textual data related 
to a portion of multimedia data. The motivation for doing so would have been to allow navigation to specific 
portions of multimedia data based on the annotated data. 

Regarding Dependent claim 28, with dependency of claim 26, Kondo teaches selecting portions of data 
from multimedia information. Further he suggests that portions of multimedia data can be retrieved for more 
than one multimedia file, thereby including a second portion extracted from a second multimedia (abstract, 
column 1, lines 55-67 & column 2, lines 1-17 & column 16 lines 20-28). Kondo fails to explicitly teach the 
printing of the portions of multimedia data. Kanevsky teaches wherein the code for printing the consolidated 
printable representation on the paper medium to generate the paper document comprises: Code for printing 
text information on at least one page of the one or more printed pages of the paper document such that 
words in the text information that satisfy the selection criterion are annotated; Code for printing one or more 
video frames on at least one page of the one or more printed pages of the paper document such that at least 
one video frame of the one or more video frames that satisfies the selection criterion is annotated (column 5, 
lines 55-67, wherein the user chooses one section of the video to print based on the criteria selected by the 
user). Kanevsky does teach printing of data including video data from a portion of the multimedia information 
but does not include annotation based on the user-defined criteria. Orr teaches the annotation of the 
video/text information (column 1 , lines 55-62). At the time of the invention it would have been obvious to 
one of ordinary skill in the art to include annotation of video/textual data related to a portion of multimedia 
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data. The motivation for doing so would have been to allow navigation to specific portions of multimedia data 
based on the annotated data. 

It is noted that any citation [[s]] to specific, pages, columns, lines, or figures in the prior art references and 
any interpretation of the references should not be considered to be limiting in any way. A reference is 
relevant for all it contains and may be relied upon for all that it would have reasonably suggested to one 
having ordinary skill in the art. [[See, MPEP 2123]] 

Response to Arguments 

7. . Applicant's arguments filed 03/13/07 have been considered but are not persuasive. 

(1) Applicant Argues: Applicants respectfully disagree because there is a substantial difference 
between "searching features of a portion of data", and "analyzing the multimedia information stored by the 
plurality of multimedia documents in response to the input to identify portions of multimedia information that 
satisfy the selection criterion" as recited in claim 1 . (pg 12, paragraph 2) 

Kondo simply fails to teach or suggest that the portions of multimedia are actually searched by the 
search unit of Kondo as alleged in the Office Action, (pg 13, paragraph 1) 

Thus, even giving the claim terms their broadest reasonable interpretation, it is clear that the 
process of analyzing multimedia information stored by a plurality of multimedia documents in response to 
input to identify portions of multimedia information that satisfy a selection criterion specified by the input as 
recited in claim 1 is substantially different from Kondo's disclosure of searching one pre-created view object 
after another to determine whether features or attributes stored in the view object match input provided by a 
user, (pg 13, paragraph 2) 



The Examiner Respectfully Disagrees: The claim describes that the multimedia information is analyzed in 
response to the input that satisfy the selection criterion. The selection criterion is defined in applicant's 
specification as follows: "The selection criteria may be based upon any attributes of the multimedia 
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documents or their contents, or upon user specified topics of interest, and the like." (see pg 7, line 33). 
Thus the searched view objects are attributes of the multimedia documents. The fact that they are searched 
by a user is a criterion used to determine which portion of multimedia is returned. Once the attributes or view 
objects based on the users search or criteria is met then the multimedia information is analyzed, analyzed 
because that information is retrieved via displayO and Play() methods invoked by the view object 
management part (see column 1, lines 55-67 & column 2, lines 1-10 & column 3, lines 39-67). Furthermore 
applicant already describes in argument 3 that the view objects include attributes by stating " ..attributes 
stored in the view object Furthermore what the Kondo reference actually suggests is displaying and 
reproducing a portion of data corresponding to a searched view object, or multimedia data including the 
portion of the data (see abstract & column 3, lines 20-25). 

It is not necessary that the references actually suggest, expressly or in so many words the changes or 
improvements that applicant has made. The test for combining references is what the references as a 
whole would have suggested to one of ordinary skill in the art . In re Sheckler, 168 USPQ 716 (CCPA 
1971); In re McLaughlin 170 USPQ 209 (CCPA 1971); In re Young 159 USPQ 725 (CCPA 1968). 

(2) Applicant Argues: Thus, merely because it would be "easily possible" according to the reasoning of the 
Office Action does not accord that the missing subject matter in Kondo may be established bv probabilities 
or possibilities- 
Applicants fail to see how combining multiple view objects into one appraises one of ordinary 
skilled in the art that the multimedia information stored bv the plurality of multimedia documents is analyzed 
as recited in claim 1 in response to the input to identify portions of multimedia information include at least a 
first portion extracted form a first multimedia document from the plurality of multimedia documents and a 
second portion extracted from a second multimedia document from the plurality of multimedia documents. 
(pg 14, paragraph 2 & pg 15, paragraph 1) 

The Examiner Respectfully Disagrees: Such probabilities. and possibilities as alleged by the applicant are 
infact reasonable interpretations, such used by a skilled artisan to understand the teachings as a whole of 
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the Kondo reference. Because it would be unreasonable to limit the teachings of Kondo to only a single 
multimedia document when there is infact a " different media and handling of large amount of data" thus 
requiring a database that can handle different data types as described by Kondo in Column 4, lines 23- 
27. In column 15, lines 63-65 Kondo further states "Then, the process performed in Steps S52 through S57 
is repeated for each file ", thus the process of gathering view objects are based on file names and for each 
multimedia file. Further column 16 lines 20-28 states "If view objects in non-sequential periods, such as the 
one included in another file of video, or the one included in non-sequential portions of video, they are 
grouped as the set S that is a set of non-sequential view objects" here Kondo at least suggests that portions 
of multimedia data can be retrieved for more than one multimedia file, thereby including a second portions 
extracted from a second multimedia. 

Clearly the multimedia information (a portion of data) stored by the plurality of multimedia documents 
(sequential data) is analyzed (displayed/retrieved) in response to the view objects searched by the user. 



Conclusion 
References Cited 

8. The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. 

• Rajasekharan (U.S. Pub 2003/0024975) discloses "System And Method For authoring And 
providing Information relevant To The Physical World" 

• Tsuruta (U.S. 7,152, 206) discloses "Printed Matter Producing Method, Printed Matter Producing 
Apparatus Utilizing Said Method, And Computer-Readable Recording Medium" 



This is a RCE of applicant's earlier Application No. 10/001,891. All claims are-drawn to the same invention 
claimed in the earlier application and could have been finally rejected on the grounds and art of record in the next 
Office action if they had been entered in the earlier application. Accordingly, THIS ACTION IS MADE FINAL even 
though it is a first action in this case. See MPEP § 706.07(b). Applicant is reminded of the extension of time policy 
as set forth in 37 CFR 1 .136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing 
date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and 
the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no, however, event will the statutory 
period for reply expire later than SIX MONTHS from the mailing date of this final action. 

9. Any inquiry concerning this communication or earlier communications from the examiner should be directed 
to Manglesh M. Patel whose telephone number is (571) 272-5937. The examiner can normally be reached on M.F 
8:30-6:00 T.TH 8:30-3:00 Wed 8:30-7:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Stephen S. 
Hong can be reached on (571)272-4124. The fax phone number for the organization where this application or 
proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent Application Information 
Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or 
Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more 
information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the 
Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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